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TITLE 

Method and System for Dynamically Translating Closed Captions 

FIELD 

[0001] The present method and system relate to delivering closed captions to a 
television. More particularly, the present method and system provides for translating closed 
caption language in response to a user request. 

BACKGROUND 

[0002] In addition to the video and audio program portions of a television 
program, television signals include auxiliary information. An analog television signal such as 
a national television system committee (NTSC) standard television signal includes auxiliary 
data during horizontal line intervals within the vertical blanking interval. An example of 
auxiUary data is closed caption data, which is included in line 21 of field 1. Similarly, digital 
television signals typically include packets or groups of data words. Each packet represents a 
particular type of information such as video, audio or auxiliary information. 

[0003] Whether the system is analog or digital, a video receiver processes both 
video information and auxiliary information in an input signal to produce an output signal 
that is suitable for coupling to a display device. Enabling an auxiliary information display 
feature, such as closed captioning, causes a television receiver to produce an output video 
signal that includes one signal component representing video information and another signal 
component representing the auxiliary information. A displayed image produced in response 
to the output video signal includes a main image region representing the video information 
component of the output signal and a smaller image region that is inset into the main region 
of the display. In the case of closed captioning, a caption displayed in the small region 
provides a visible representation of audio information, such as speech, that is included in the 
audio program portion of a television program. 

[0004] Auxiliary data in the form of closed captioning has traditionally been 
presented in the same language as the primary audio signal. Due to the prohibitive costs of 
broadcasting a signal containing closed caption data in multiple languages, many broadcasts 

1 



80113-0372 (BCS03175) 



done in a language different from the language of the primary audio signal typically do not 
include closed captions or only provide closed captions in the language of the primary audio 
signal. 

SUMMARY 

[0005] A system and a method for translating textual data in a media signal 
includes receiving a media signal containing textual data of a first language, selectively 
transmitting the media signal to a language translation module, translating the textual data to 
a second language, and transmitting the translated textual data to a display device to be 
displayed. 

BRIEF DESCRIPTION OF THE DRAWINGS 

[0006] The accompanying drawings illustrate various embodiments of the present 
method and system and are a part of the specification. Together with the following 
description, the drawings demonstrate and explain the principles of the present method and 
system. The illustrated embodiments are examples of the present method and system and do 
not limit the scope thereof. 

[0007] Fig. 1 illustrates a communications setup configured to receive translated 
closed captions according to one exemplary embodiment. 

[0008] Fig. 2 illustrates a simplified flow diagram illustrating a data flow path 
according to one exemplary embodiment. 

[0009] Fig. 3 is a flow chart illustrating a method of providing translated closed 
captions according to one exemplary embodiment. 

[0010] Fig. 4 illustrates a communications setup including a set-top box 
configured to receive translated closed captions according to one exemplary embodiment. 

[0011] Fig. 5 illustrates a simplified flow diagram illustrating a data flow path 
according to one exemplary embodiment. 

[0012] Fig. 6 illustrates a communications setup including a home networking 
device configured to receive translated closed captions. 
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[0013] Fig. 7 illustrates a simplified flow diagram illustrating a data flow path 
according to one exemplary embodiment. 

[0014] Throughout the drawings, identical reference numbers designate similar, 
but not necessarily identical, elements. 

DETAILED DESCRIPTION 

[0015] The present specification describes a method and a system for dynamically 
translating and providing user selectable closed captions in receiving devices. More 
specifically, the present method and system include transmitting a video signal containing 
encoded closed caption text to a receiving device that is communicatively coupled to a 
language translation module. The language translation module then decodes the encoded 
closed caption text, translates the closed caption text to a language specified by a user, and 
transmits the translated text to a display device where it may be viewed by the user. 

[0016] In the present specification and in the appended claims, the term 
'^translation" or "language translation" is meant to be imderstood broadly as any process 
whereby data or information in one language is converted into a second language. Similarly, 
the term "language translation module" (LTM) or "language translation engine" is meant to 
be understood broadly as any hardware or software that is configured to receive data in a first 
language and then translate that data into a second language. Additionally, the term "closed 
caption" is meant to be understood broadly as any textual or graphical representation of audio 
presented as a part of a television, movie, audio, computer, or other presentation. A "set-top 
box" is meant to be imderstood broadly as any device that enables a television set to become a 
user interface to the Internet, enables a television set to receive decoded digital NTSC or 
digital television (DTV) broadcasts. Similarly, a "home networking device" is any device 
configured to network electronic components in a structure using any number of network 
mediums including, but in no way limited to, a structure's pre-existing power lines, infi-ared 
(I/R), or radio frequencies (RF). A "head-end insertion device" is any device configured to 
insert, receive, or translate a signal received by a cable head-end to one or all of the 
subscribers serviced by the cable provider. A "cable head-end" is a facility or a system at a 
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local cable TV office that originates and commxinicates cable TV services and/or cable 
modem services to subscribers. 

[0017] In the following description, for purposes of explanation, nimierous 
specific details are set forth in order to provide a thorough xmderstanding of the present 
method and system for dynamically translating and providing user selectable closed captions 
in receiving devices. It will be apparent, however, to one skilled in the art that the present 
method may be practiced without these specific details. Reference in the specification to 
"one embodiment" or "an embodiment" means that a particular feature, structure, or 
characteristic described in connection with the embodiment is included in at least one 
embodiment. The appearance of the phrase "in one embodiment" in various places in the 
specification are not necessarily all referring to the same embodiment. 

Exemplary Overall Structure 

[0018] Figure 1 illustrates an exemplary setup of a system (100) configured to 
dynamically translate and provide a user with user-selected closed captions in a receiving 
device. As shown in Figure 1, an exemplary embodiment may include a user location (120) 
configured to receive a data signal (110) containing encoded closed caption text. Figure 1 
also illustrates that the user location (120) is communicatively coupled to a display device 
(140) that is subsequently coupled to a language translation module or engine (130). 

[0019] The user location (120) configured to receive a data signal (110) illustrated 
in Figure 1 may be any location, stmcture or otherwise, where a user may access and receive a 
data signal. The user location may include, but is in no way limited to, a home, an office 
building, a school, a hospital, a church, an automobile, a boat, or any other structure suited to 
receive a data signal. Moreover, the user location (120) may not be a structure such as in the 
exemplary case of a wireless signal reception device. The user location (120) may also 
include a data signal receiver (not shown) configured to receive a data signal (1 10) at the 
above-mentioned user location (120). Additionally, the user location (120) may also include 
a coupling means (not shown) for coupling the user location (120) to the display device (140). 
The coupling means may include, but is in no way limited to, coaxial cable, optical cable, VR 
capabilities, or RF capabilities. 
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[0020] Figure 1 illustrates a data signal (1 10) being received by the user location 
(120). The data signal (1 10) illustrated in Figure 1 may be any signal, analog or digital, that 
may be received at a user location and processed by a display device (140). According to one 
exemplary embodiment, the data signal (110) includes data representing audio content as well 
as data representing encoded closed caption text. 

[0021] The display device (140) receiving the data signal (1 10) in the exemplary 
embodiment illustrated in Figure 1 may be any device configured to present a graphical 
representation of a received data signal (110). The display device (140) depicted in Figure 1 
may include, but is in no way limited to, a television, a projector, a liquid crystal display 
(LCD), a computer screen, a personal digital assistant (PDA), a cell phone, or a watch. 

[0022] As shown in Figure 1, the display device (140) is commimicatively 
coupled to a language translation module (LTM) or engine (130). The language translation 
module or engine (130) illustrated in Figure 1 may be any hardware or software that is 
configured to receive data in a first language and then translate the data into a second 
language. In the case of a hardware LTM (130), the LTM may include, but is in no way 
limited to, a processor for converting data of a first language into a second language, a data 
storage component that may be accessed by the processor to house a niunber of language 
translations, power connections for powering the LTM components, inputs and outputs (I/O), 
and possibly a heat sink to dissipate heat generated by the processor. In the case of a software 
LTM (130), the LTM may be located on the hardware of the display device (140) itself as 
shown in Figure 1 or it may reside on a separately coupled component. 

Exemplary Implementation and Operation 

[0023] Figure 3 is a flow chart illustrating a method for dynamically translating 
and providing user selectable closed captions in reviewing devices. As shown in Figure 3, 
one exemplary method for dynamically translating and providing user selectable closed 
captions in receiving devices begins by receiving a data signal containing a language data 
stream (step 200). Once the data signal is received, the present system determines whether 
the user has activated the closed caption option on the display device (step 210). If the closed 
caption option has not been activated on the display device (NO, step 210), the system 
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transmits the data signal to the display device (140; Fig. 1) without any signal modifications 
(step 250). If, however, the present system determines that the closed captions option has 
been activated on the display device (YES, step 210), the system then determines whether the 
user has requested closed caption data in a secondary language (step 220). If the user has not 
requested the closed caption data in a secondary language (NO, step 220), the system 
transmits the signal to the display device (140; Fig. 1) without any signal modifications (step 
250), If, however, the user has requested the closed caption data in a secondary language 
(YES, step 220), the present system accesses the LTM (step 230). Once the LTM has been 
accessed, the data signal is fed to the LTM where the LTM translates the closed caption data 
into the requested secondary language (step 240). Once translated, the data signal including 
the translated closed caption data is transmitted to the display device (step 250) where it is 
subsequently displayed on the display device (step 260). The above-mentioned method will 
now be explained in further detail below with reference to Figure 2. 

[0024] As shown in Figure 2, the present method begins by receiving a data signal 
containing a language data stream (step 200). The data signal received by the present system 
and method may be received from any source configured to transmit a data signal including, 
but in no way limited to, a coaxial cable connection, an Intemet connection, or a satellite 
television connection. According to the exemplary embodiment illustrated in Figure 2, the 
data signal (110) received by the present system (100; Fig. 1) contains closed caption data. 
The closed caption data contained in the data signal (1 10) is likely, though not necessarily, 
encoded. As shown in figure 2, the closed caption data (110) is typically carried by the closed 
caption 1 service (CCl) according to the national television systems committee (NTSC). The 
NTSC has designated CCl and CCS for synchronized captions (synchronizing the closed 
captions with the audio signal). Similarly, the advanced television systems committee 
(ATSC) requires that closed caption information be carried on caption service 1 for digital 
television (DTV) captioning. While the present exemplary embodiment is shown complying 
with current United States closed caption requirements, the present system and method may 
be implemented to comply with any international closed caption requirements 

[0025] Returning again to Figure 3, once the data signal has been received, the 
present system (100; Fig. 1) determines whether the closed caption option has been activated 
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on the display device (step 210). If no closed caption option has been activated on the display 
device (NO, step 210), there is no need to translate the closed caption signal portion of the 
data signal. As a result, the data signal is routed directly to the display device (140; Fig. 1) 
without performing any signal modifications (step 250). If, however, the system determines 
that the closed caption option has been activated on the display device (YES, step 210), the 
system then determines whether a user has requested that the closed caption data be translated 
to a secondary language (step 220). A request for the closed caption data to be translated to a 
secondary language may be received by the present system (100; Fig. 1) in a number of 
manners including, but in no way limited to, a request made by an I/R remote on the display 
device, a request made on a GUI presented by the display device, or a request made by 
pressing a number of control buttons or knobs located either on the display device (140; Fig. 
1) or on the LTM (130; Fig. 1). If no such request has been made to the present system (NO, 
step 220), then there is no need to translate the closed caption data and the signal is 
transmitted to the display device without any signal modifications (step 250). If, however, the 
user has requested the closed caption data in a secondary language (YES, step 220), the 
present system accesses the LTM (step 230). 

[0026] Returning again to Figure 2, once the LTM has been accessed, the data 
signal (110) is fed to the LTM (130) where the LTM translates the closed caption data into 
the requested secondary language (step 240; Fig. 3). As shown in Figure 2, when the LTM 
(130) receives the original data signal (110) containing the closed caption data to be translated 
in the CCl service, the LTM (130) translates the closed caption data into the requested 
secondary language and prepares it for transmission to the display device. The LTM (130) 
may translate the closed caption data into the requested secondary language using any 
language translation methods used in the art including, but in no way limited to, using word 
association patterns. 

[0027] Once translated, the data signal including the translated closed caption data 
is transmitted to the display device (step 250; Fig. 3). As shown in Figure 2, the original data 
signal (1 10) is transmitted to the display device (140) still containing the un-translated closed 
caption data in the CCl service or Caption Service 1. Additionally, the translated closed 
caption data (150) is transmitted to the display device (140) in the CC3 service or Caption 
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Service 3. This exemplary method of transmitting both translated (150) and un-translated 
(110) closed caption data to the display device allows the user to select either translated or im- 
translated closed captions depending on which service is displayed by the display device 
(140). Once the data signal (1 10, 150) is received by the display device (140), it is 
subsequently displayed by the display device (step 260). 

[0028] The above-mentioned method and system for dynamically translating and 
providing user selectable closed captions in receiving devices allows a user to control the 
language closed caption data is presented without burdening the broadcaster with the expense 
of transmitting closed caption data in multiple languages. This abihty to translate closed 
captions may aid the user in learning another language or allowing a user to view the closed 
captions in their native language. 

Alternative Embodiment 

[0029] Figure 4 and Figure 5 illustrate an alternative embodiment of the present 
method and system (300) for dynamically translating and providing user selectable closed 
captions in receiving devices. As shown in Figure 4, an interactive set- top box (310) may be 
coupled to the display device (140) according to one exemplary embodiment. A set-top box 
(310) may be any device that enables a display device (140) to become a user interface to the 
Intemet, enables a television set to receive decoded digital NTSC or digital television (DTV) 
broadcasts. Additionally, as is shovm in Figure 4, the set-top box (310) may serve as the host 
totheLTM(130). 

[0030] As shown in Figure 5, once a data signal (110) containing closed caption 
data in the CCl service or Caption Service 1 is received in the user location (120; Fig. 5), it is 
transmitted to the set-top hosting the LTM (310). As was previously mentioned above, the 
LTM may be any hardware or software that is configured to receive data in a first language 
and then translate the data into a second language. Once in the set-top hosting the LTM (310), 
the data signal (110) may be translated into a user selected secondary language as was 
explained previously. Once the translation has been completed, both the original data signal 
(110) containing the original closed caption data in the CCl service or Caption Service 1 and 
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the translated closed caption data in the CC3 service or Caption Service 3 (320) may be 
transmitted to the display device (140) for viewing. 

[0031] The original data signal (1 10) and the translated closed caption data (320) 
may be transmitted to the display device (140) through any number of traditional connection 
means including, but in no way limited to RCA, optical, I/R, RP, and/or S-video connections. 
It is also within the scope of the present method and system for the interactive set-top hosting 
the LTM (310) to be integrated with the display device (140) to form a single functional unit. 

[0032] The embodiment illustrated in Figure 4 and Figure 5 enables the 
manufacturer of the set top box and/or the signal service provider to provide multi-language 
closed captions as a subscription option. According to this exemplary embodiment, when the 
user has not yet ordered multi-lingual closed captions, the LTM remains in a de-activated 
state. However, when a user has ordered multi-language closed captions, the signal provider 
enables the LTM through an activation code and provides the LTM with the ability to 
download a number of databases containing translation libraries for a number of specified 
languages. Once the user desires to view the closed captions in a secondary language, the 
LTM including the downloaded language databases may be accessed as explained above 
allowing for dynamic translation of the audio signal into a user specified secondary language. 

[0033] Alternatively, Figure 6 illustrates an exemplary embodiment of a system 
(400) for dynamically translating and providing user selectable closed captions in receiving 
devices (140), wherein the system includes a home networking device (510) hosting the LTM 
(130). When a home networking device is coupled to the set-top box (310) or the display 
device (140), the LTM being hosted by the home networking device (510) may translate 
closed caption data and produce closed caption data (520) in a secondary language. 

[0034] Figure 7 illustrates a simplified flow diagram illustrating a data flow path 
according to one exemplary embodiment. As shown in Figure 7, a data signal (110) 
containing closed caption data in the CCl service or Caption Service 1 is received in the user 
location (120; Fig. 6) and transmitted to the home networking device hosting the LTM (410). 
Once in the home networking device hosting the LTM (410), the data signal (110) may be 
translated into a user selected secondary language as was explained previously. Once 
translated, both the original data signal (110) containing the original closed caption data in the 
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CCl service or Caption Service 1 and the translated closed caption data in the CCS service or 
Caption Service 3 (420) may be transmitted to a set-top box (310) and on to a display device 
(140). It will be generally imderstood that the present system and method may be varied by 
allowing various components in the system to host the LTM (130) including, but in no way 
limited to, a display device, a set-top box, or a home network device. 

[0035] A cable head-end insertion device may also host the LTM according to one 
exemplary embodiment. A cable head-end device is any device configured to insert, receive, 
or translate a signal received by a cable head-end to one or all of the users serviced by the 
cable provider. By allowing a cable head-end insertion device to host the LTM, a cable 
provider may simultaneously supply all of its subscribers with a data signal containing both 
the original closed captions on the CCl service or Caption Service 1 and translated closed 
captions on the CC3 service or Caption Service 3. According to this exemplary embodiment, 
the cable service provider may provide translated closed captions in the second most 
predominant language spoken in the area thereby catering to the linguistic needs of a larger 
portion of their customers. Similarly, any broadcaster of a data signal may host an LTM, 
enabling them to provide translated data to their customers. 

[0036] In conclusion, the present method and system for dynamically translating 
and providing user selectable closed captions in receiving devices, in its various 
embodiments, allows for the translation of closed caption data from one language to a second 
language without burdening the signal provider. Specifically, the present system and method 
provides a language translation module in a user device that is capable of dynamically 
translating a signal containing closed caption data into various user specified languages. 

[0037] The preceding description has been presented only to illustrate and 
describe the present method and system. It is not intended to be exhaustive or to limit the 
present method and system to any precise form disclosed. Many modifications and variations 
are possible in light of the above teaching. 

[0038] The foregoing embodiments were chosen and described in order to 
illustrate principles of the method and system as well as some practical applications. The 
preceding description enables others skilled in the art to utilize the method and system in 
various embodiments and with various modifications as are suited to the particular use 
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contemplated. It is intended that the scope of the method and system be defined by the 
following claims. 



11 



